Interpersonal stance recognition using non-verbal signals on several time windows

نویسندگان

  • Mathieu Chollet
  • Magalie Ochs
  • Catherine Pelachaud
چکیده

We present a computational model for interpreting nonverbal signals of a user during an interaction with a virtual character in order to obtain a representation of his interpersonal stance. Our model starts, on the one hand, from the analysis of multimodal signals. On the other hand, it takes into account the temporal patterns of the interactants behaviors. That is it analyses signals and reactions to signals in their immediate context, as well as features of signal production patterns and reaction patterns on different time windows : signal reaction, sentence reaction, conversation topic, whole interaction. In this paper, we propose a first model parameterized using data obtained from the literature on the expressions of stances through interpersonal behavior.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Beyond backchannels: co-construction of dyadic stancce by reciprocal reinforcement of smiles between virtual agents

When two persons participate in a discussion, they not only exchange the concepts and ideas they are discussing, they also express attitudes, feelings and commitments regarding their partner: they express interpersonal stances. Endowed with backchannel model, several virtual agents are able to react to their partners’ behaviour through their non-verbal behaviour. In this paper, we go beyond thi...

متن کامل

From Non-verbal Signals Sequence Mining to Bayesian Networks for Interpersonal Attitudes Expression

In this paper, we present a model and its evaluation for expressing attitudes through sequences of non-verbal signals for Embodied Conversational Agents. To build our model, a corpus of interpersonal job interview interactions has been annotated at two levels: the non-verbal behavior of the recruiters as well as their expressed attitudes was annotated. Using a sequence mining method, sequences ...

متن کامل

Investigating Non-Verbal Behaviors Conveying Interpersonal Stances

Interpersonal stances are expressed by non-verbal behaviors on a variety of different modalities. The perception of these behaviors is influenced by the context of the interaction, how they are sequenced with other behaviors from the same person and behaviors from other interactants. In this paper, we introduce a framework considering the expressions of stances on different layers during an int...

متن کامل

EMG-based wrist gesture recognition using a convolutional neural network

Background: Deep learning has revolutionized artificial intelligence and has transformed many fields. It allows processing high-dimensional data (such as signals or images) without the need for feature engineering. The aim of this research is to develop a deep learning-based system to decode motor intent from electromyogram (EMG) signals. Methods: A myoelectric system based on convolutional ne...

متن کامل

ارتباط رفتارهای غیرکلامی، پردازش و بازشناسی هیجان با علایم مثبت و منفی در بیماران مبتلا به اسکیزوفرنیا

  Background and Objectives: Non-verbal behaviors, emotional processing and recognition play a great role in predicting the positive and negative symptoms of patients with schizophrenia. The aim of the present research was to determine the relationship of nonverbal behaviors, emotional processing and emotional recognition with positive and negative symptoms in patients with schizophrenia.   Mat...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2012